O o mo 

O^Zq-dC 
ZOOz>? 

2 7> 5 h o m 



o 
c 

m 

CO 

> 



100 

p 
lo 





4^ 

CO 



/o > 
/ m o i 

\8 5 m ' 



? s ° 

;o m £2 
q z m 

qOZ 

y m h 



14^ 
O 

lo 





si 








r~ i 
















1! 


O D 






55 1 


m > 


ORTE 





ALL TARGETING 
FUNCTIONS 




TARGETING 
FUNCTION 






> 


> 




O 


< 




TJ 


m 




m 


RA 




73 
~n 


- O 




O 


? m 




73 






MAN 






O 






m 








|3 




z 

TI 






O 






73 


> 






Z 






o 






m 




O 






z 



O r- 

5 > 
3° 



> 
< 
m 



? m 



> 

D 
TJ 

m 

73 

"n 
O 
73 

> 
Z 

o 
m 



cn 
oo 



m g 



i ! 

o 



o > 



= °\ 

Z TJ t 

73 n 
2 o 

> 73 



m =3 



z z o > 



ol 
m/ 




m 

x 



A 



O q m -u rn 

2 3 co > 73 

5 > d £ 3 

<o 4j F > O 

Z! r- _i m ^ 

O > ^ H > 

Z H § m 2 

0) o z 73 o / 



636 



620 



AD PERFORMANCE 
INFORMATION 
(GENERAL) 



2. 



632 



DOCUMENT 
INFORMATION 



2. 



OTHER AD 
INFORMATION 




640 



655 j~j Z__ 

WJ AD; SCORE / 



AD PERFORMANCE INFORMATION 
((DOCUMENT) SPECIFIC) 



FIGURE 6 



699 




AD; ADJUSTED SCORE 




740 



886 



TARGETING FUNCTION 
PERFORMANCE INFORMATION 
((DOCUMENT) SPECIFIC) 




895 



850 



FIGURE 8 



DATA COLLECTION 
,ND AGGREGATION, 



y 

900 



LOG DOCUMENT IDENTIFIER, 

AD (GROUP) IDENTIFIER, 
IMPRESSION INFORMATION 



910 



^20 



ACCEPT: 

(A) DOCUMENT IDENTIFIER, AD (GROUP) IDENTIFIER, USER BEHAVIOR INFORMATION, 

COST INFORMATION; 

(B) HOST IDENTIFIER.AD (GROUP) IDENTIFIER, USER BEHAVIOR INFORMATION, COST 

INFORMATION; AND/OR 
(C) HOST IDENTIFER, TARGETING FEATURE, USER BEHAVIOR INFORMATION, COST 

INFORMATION, 
CONTINUOUSLY OR INCREMENTALLY 



UPDATE COUNTS/STATISTICS 
USING ACCEPTED AND 
LOGGED INFORMATION 



.... L 

THRESHOLD INFORMATION 
USING COUNTS 

::::i:z: 



930 



940 



ADJUST (e.g., SMOOTH) DATA 1^950 
USING CONFIDENCE MEASURE! V 



STORE UPDATED COUNTS/ 
STATISTICS (e.g., WITH 
DOCUMENT IDENTIFIER OR HOST 
IDENTIFIER AS A LOOKUP KEY) 



960 



( RETURN y\j 



970 



FIGURE 9 



ACCEPT 
DOCUMENT 
IDENTIFIER 



1010 



DETERMINE K BE 
ADS (AD GROUPS 
USING STORED/A( 


.ST PERFORMING 
) FOR DOCUMENT 
3GREGATED DATA 




r 


GENERATE A SET OF CANDIDATE 
ADS INCLUDING AT LEAST THE K 
DETERMINE ADS (AD GROUPS) 



1020 



.1030 



( RETURN JX) 



1040 



FIGURE 10 



/ AD SCORE A 
\ ADJUSTMENT J 



1100 



ACCEPT AD (GROUP) 
CANDIDATES AND AD 
(GROUP) SCORES 



1110 



ACCEPT DOCUMENT 
IDENTIFIER AND/OR 
HOST IDENTIFIER 



1120 



< 



FOR EACH ACCEPTED AD 
(GROUP) CANDIDATE 




1130 



ACCEPT DOCUMENT SPECIFIC/HOST SPECIFIC 
PERFORMANCE INFORMATION FOR AD (GROUP) 
(AND AVERAGE PERFORMANCE INFORMATION FOR 
DOCUMENT/HOST OVER ALL ADS (AD GROUPS) 



1140 



ADJUST AD (GROUP) SCORE USING ACCEPTED 

DOCUMENT SPECIFIC/HOST SPECIFIC 
PERFORMANCE INFORMATION (AND ACCEPTED 
AVERAGE PERFORMANCE INFORMATION) 



1150 



YES 



ANOTHER AD (GROUP) 
CANDIDATE? 

NO 




1160 



( RETURN *y\y 1 



1170 



FIGURE 11 



( AD PERFORMANCE \ 
INFORMATION ADJUSTMENT J 



1200 
1210 



ACCEPT ELIGIBLE AD (GROUP) , , 
CANDIDATES AND AD (GROUP) [V 
PERFORMANCE INFORMATION 



ACCEPT DOCUMENT 
IDENTIFIER/HOST IDENTIFIER 



1220 



FOR EACH ELIGIBLE AD 
(GROUP) CANDIDATE 



X^1230 



ACCEPT DOCUMENT SPECIFIC/HOST SPECIFIC 
PERFORMANCE INFORMATION FOR AD (GROUP) 
(AND AVERAGE PERFORMANCE INFORMATION FOR 
DOCUMENT/HOST OVER ALL ADS (AD GROUPS) 



:40 



ADJUST AD (GROUP) PERFORMANCE INFORMATION 
USING ACCEPTED DOCUMENT SPECIFIC/HOST 
SPECIFIC PERFORMANCE INFORMATION (AND 
ACCEPTED AVERAGE PERFORMANCE INFORMATION) 



1250 



YES 



ANOTHER AD (GROUP) 
CANDIDATE? 

"no ~ 




1260 



( RETURN ~y\y 



1270 



FIGURE 12 



DOCUMENT SPECIFIC/HOST SPECIFIC 
SCORING FUNCTION SELECTION 



1300 



ACCEPT DOCUMENT IDENTIFIER/ 
HOST IDENTIFIER 



^1305 



DETERMINE SCORING FUCNTION [THAT WAS 

USED TO SERVE ADS] WITH THE BEST 
PERFORMANCE FOR THE DOCUMENT/HOST 



1310 



USE DETERMINED 
SCORING FUNCTION TO 
SCORE CANDIDATE ADS 



1315 



( RETURN *y\y 



1320 



FIGURE 13A 



c 



DOCUMENT SPECIFIC/HOST SPECIFIC 
SCORING FUNCTION ADJUSTMENT 



1350 



ACCEPT DOCUMENT IDENTIFIER/ 
HOST IDENTIFIER 



A 1355 




FOR EACH COMPONENT/PARAMETER 
OF AD SCORING FUNCTION 




1360 



ACCEPT DOCUMENT SPECIFIC/HOST SPECIFIC 
PERFORMANCE INFORMATION PARAMETER/ 
COMPONENT (AND AVERAGE PERFORMANCE V 

INFORMATION FOR DOCUMENT/HOST OVER ALU. 
PARAMETERS/COMPONENTS) 



1365 



ADJUST IMPORTANCE OF COMPONENT/PARAMETER 
IN SCORING FUNCTION USING ACCEPTED 
DOCUMENT SPECIFIC/HOST SPECIFIC 
PERFORMANCE INFORMATION (AND ACCEPTED 
AVERAGE PERFORMANCE INFORMATION) 



1370 



YES 



ANOTHER 
COMPONENT/ 
PARAM ETER? 

NO 



( RETURN "y\j 



1380 



FIGURE 13B 



CONCEPT/TOPIC BASED AD (GROUP) 
ERFORMANCE ESTIMATION/ADJUSTMEN 



2 



1400 



ACCEPT OR EXTRACT DOCUMENT r\ 1405 
CONCEPTS/HOST CONCEPTS [ V 

XC FOR EAC^CONCEPf~^y \y 10 



DETERMINE (FIRST SET OF) ^\ 1415 
CONCEPT-RELEVANT ADS 



V 



FOR EACH DETERMINED AD 



1420 



1 


r 


LOOKUP DOCUMENT SPECIFIC / HOST SPECIFIC 
PERFORMANCE INFORMATION FOR AD 


YES — y 


■ : — = /\ 



1425 



1435 



ANY 

tf)S NOT DETERMINED TO BE CONCEPT^ 
RELEVANT BUT WITH HIGH PERFORMANCE 

? 

NO~ 



YES 



DETERMINE CONCEPT PERFORMANCE 
USING PERFORMANCE OF ADS 
RELATED TO THE CONCEPT 




FOR EACH DETERMINED AD 
(WITHOUT PERFORMANCE 



1 


r 


UPDATE PERFORMANCE 
INFORMATION USING ESTIMATED 
! CONCEPT PERFORMANCE 


YES ^ - 


■ ^ ^1460 



DETERMINE 
SECOND SET OF 
ADS INCLUDING 

FIRST SET OF 
ADS AND OTHER, 

HIGH 
PERFORMANCE, 
AD(S) 

r 



1455 



7 



1440 



YES 



NO 



<^ ANOTHER CONCEPTT^V/ 



1465 



FIGURE 14 



NO 

_ N , 1470 

( RETURN JV 




o 

,-i c 
m 
cn 



en 
O 
O 



cn 



5* 



is ° 

o O 

o ^ 

w m 

h 2 



